Pandas_Profiling-Twitter_Data

Dataset statistics

Number of variables	23
Number of observations	1964
Missing cells	98
Missing cells (%)	0.2%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	307.1 KiB
Average record size in memory	160.1 B

Variable types

CAT	12
NUM	7
BOOL	3
URL	1

Warnings

`timezone` has constant value "1964"	Constant
`name` has a high cardinality: 911 distinct values	High cardinality
`date` has a high cardinality: 595 distinct values	High cardinality
`time` has a high cardinality: 1916 distinct values	High cardinality
`p1` has a high cardinality: 373 distinct values	High cardinality
`p2` has a high cardinality: 396 distinct values	High cardinality
`p3` has a high cardinality: 403 distinct values	High cardinality
`fav_count` is highly correlated with `retweet_count`	High correlation
`retweet_count` is highly correlated with `fav_count`	High correlation
`name` has 98 (5.0%) missing values	Missing
`rating_numerator` is highly skewed (γ1 = 39.23799602)	Skewed
`time` is uniformly distributed	Uniform
`tweet_id` has unique values	Unique
`text` has unique values	Unique
`img_url` has unique values	Unique

Reproduction

Analysis started	2020-12-14 04:30:55.390777
Analysis finished	2020-12-14 04:31:12.724084
Duration	17.33 seconds
Software version	pandas-profiling v2.9.0
Download configuration	config.yaml

tweet_id
Categorical

UNIQUE

Distinct	1964
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

672622327801233409	1
747512671126323200	1
674053186244734976	1
743609206067040256	1
730924654643314689	1
Other values (1959)	1959

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
672622327801233409	1	0.1%
747512671126323200	1	0.1%
674053186244734976	1	0.1%
743609206067040256	1	0.1%
730924654643314689	1	0.1%
800751577355128832	1	0.1%
834931633769889797	1	0.1%
752173152931807232	1	0.1%
751132876104687617	1	0.1%
810984652412424192	1	0.1%
Other values (1954)	1954	99.5%

Frequencies of value counts

Unique

Unique	1964 ?
Unique (%)	100.0%

Histogram of lengths of the category

Length

Max length	18
Median length	18
Mean length	18
Min length	18

source_app
Categorical

Distinct	3
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

Twitter for iPhone	1926
Twitter Web Client	28
TweetDeck	10

Frequencies
Length

Value	Count	Frequency (%)
Twitter for iPhone	1926	98.1%
Twitter Web Client	28	1.4%
TweetDeck	10	0.5%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	18
Median length	18
Mean length	17.95417515
Min length	9

text
Categorical

UNIQUE

Distinct	1964
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

This is Bo. He was a very good First Doggo. 14/10 would be an absolute honor to pet https://t.co/AdPKrI8BZ1	1
Meet Chester. He just ate a lot and now he can't move. 10/10 that's going to be me in about 17 hours https://t.co/63jh1tYZa5	1
This is Severus. He's here to fix your cable. Looks like he succeeded. Even offered to pupgrade your plan. 13/10 h*ckin helpful https://t.co/aX4brLLpWZ	1
This is Ruby. She just turned on the news. Officially terrified. 11/10 deep breaths Ruby https://t.co/y5KarNXWXt	1
Vibrant dog here. Fabulous tail. Only 2 legs tho. Has wings but can barely fly (lame). Rather elusive. 5/10 okay pup https://t.co/cixC0M3P1e	1
Other values (1959)	1959

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
This is Bo. He was a very good First Doggo. 14/10 would be an absolute honor to pet https://t.co/AdPKrI8BZ1	1	0.1%
Meet Chester. He just ate a lot and now he can't move. 10/10 that's going to be me in about 17 hours https://t.co/63jh1tYZa5	1	0.1%
This is Severus. He's here to fix your cable. Looks like he succeeded. Even offered to pupgrade your plan. 13/10 h*ckin helpful https://t.co/aX4brLLpWZ	1	0.1%
This is Ruby. She just turned on the news. Officially terrified. 11/10 deep breaths Ruby https://t.co/y5KarNXWXt	1	0.1%
Vibrant dog here. Fabulous tail. Only 2 legs tho. Has wings but can barely fly (lame). Rather elusive. 5/10 okay pup https://t.co/cixC0M3P1e	1	0.1%
This is Lacy. She's tipping her hat to you. Daydreams of her life back on the frontier. 11/10 would pet so well https://t.co/fG5Pk3Et1I	1	0.1%
We only rate dogs. Please don't send in other things like this very good Christmas tree. Thank you... 13/10 https://t.co/rvSANEsQZJ	1	0.1%
This is Billy. He sensed a squirrel. 8/10 damn it Billy https://t.co/Yu0K98VZ9A	1	0.1%
I have no words. Just a magnificent pup. 12/10 https://t.co/viwWHZgX8j	1	0.1%
This is Brandi and Harley. They are practicing their caroling for later. Both 12/10 festive af https://t.co/AbBDuGZUpp	1	0.1%
Other values (1954)	1954	99.5%

Frequencies of value counts

Unique

Unique	1964 ?
Unique (%)	100.0%

Histogram of lengths of the category

Length

Max length	167
Median length	132
Mean length	122.5096741
Min length	36

rating_numerator
Real number (ℝ_≥0)

SKEWED

Distinct	33
Distinct (%)	1.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	12.17605906
Minimum	0
Maximum	1776
Zeros	1
Zeros (%)	0.1%
Memory size	15.3 KiB

Quantile statistics

Minimum	0
5-th percentile	6
Q1	10
median	11
Q3	12
95-th percentile	13
Maximum	1776
Range	1776
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	41.67975521
Coefficient of variation (CV)	3.423090755
Kurtosis	1640.906289
Mean	12.17605906
Median Absolute Deviation (MAD)	1
Skewness	39.23799602
Sum	23913.78
Variance	1737.201995
Monotocity	Not monotonic

Histogram with fixed size bins (bins=33)

Value	Count	Frequency (%)
12	444	22.6%
10	416	21.2%
11	393	20.0%
13	249	12.7%
9	151	7.7%
8	95	4.8%
7	52	2.6%
14	33	1.7%
5	32	1.6%
6	32	1.6%
Other values (23)	67	3.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0	1	0.1%
1	4	0.2%
2	9	0.5%
3	19	1.0%
4	16	0.8%

Value	Count	Frequency (%)
1776	1	0.1%
420	1	0.1%
204	1	0.1%
165	1	0.1%
144	1	0.1%

rating_denominator
Real number (ℝ_≥0)

Distinct	12
Distinct (%)	0.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	10.48472505
Minimum	10
Maximum	170
Zeros	0
Zeros (%)	0.0%
Memory size	7.7 KiB

Quantile statistics

Minimum	10
5-th percentile	10
Q1	10
median	10
Q3	10
95-th percentile	10
Maximum	170
Range	160
Interquartile range (IQR)	0

Descriptive statistics

Standard deviation	6.862321979
Coefficient of variation (CV)	0.6545066223
Kurtosis	313.9517317
Mean	10.48472505
Median Absolute Deviation (MAD)	0
Skewness	16.83789194
Sum	20592
Variance	47.09146294
Monotocity	Not monotonic

Histogram with fixed size bins (bins=12)

Value	Count	Frequency (%)
10	1949	99.2%
50	3	0.2%
80	2	0.1%
11	2	0.1%
170	1	0.1%
150	1	0.1%
120	1	0.1%
110	1	0.1%
90	1	0.1%
70	1	0.1%
Other values (2)	2	0.1%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
10	1949	99.2%
11	2	0.1%
20	1	0.1%
40	1	0.1%
50	3	0.2%

Value	Count	Frequency (%)
170	1	0.1%
150	1	0.1%
120	1	0.1%
110	1	0.1%
90	1	0.1%

name
Categorical

HIGH CARDINALITY
MISSING

Distinct	911
Distinct (%)	48.8%
Missing	98
Missing (%)	5.0%
Memory size	15.3 KiB

None	524
Oliver	10
Cooper	10
Charlie	10
Lucy	9
Other values (906)	1303

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
None	524	26.7%
Oliver	10	0.5%
Cooper	10	0.5%
Charlie	10	0.5%
Lucy	9	0.5%
Tucker	9	0.5%
Penny	9	0.5%
Sadie	8	0.4%
Winston	8	0.4%
Daisy	7	0.4%
Other values (901)	1262	64.3%
(Missing)	98	5.0%

Frequencies of value counts

Unique

Unique	690 ?
Unique (%)	37.0%

Histogram of lengths of the category

Length

Max length	14
Median length	4
Mean length	4.928207739
Min length	1

date
Categorical

HIGH CARDINALITY

Distinct	595
Distinct (%)	30.3%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

2015-11-28	26
2015-11-29	26
2015-11-16	25
2015-11-19	23
2015-12-01	22
Other values (590)	1842

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
2015-11-28	26	1.3%
2015-11-29	26	1.3%
2015-11-16	25	1.3%
2015-11-19	23	1.2%
2015-12-01	22	1.1%
2015-11-25	20	1.0%
2015-11-22	20	1.0%
2015-12-07	20	1.0%
2015-11-23	20	1.0%
2015-11-20	20	1.0%
Other values (585)	1742	88.7%

Frequencies of value counts

Unique

Unique	168 ?
Unique (%)	8.6%

Histogram of lengths of the category

Length

Max length	10
Median length	10
Mean length	10
Min length	10

time
Categorical

HIGH CARDINALITY
UNIFORM

Distinct	1916
Distinct (%)	97.6%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

01:00:05	3
00:08:17	3
03:56:12	2
16:00:07	2
16:10:29	2
Other values (1911)	1952

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
01:00:05	3	0.2%
00:08:17	3	0.2%
03:56:12	2	0.1%
16:00:07	2	0.1%
16:10:29	2	0.1%
18:27:32	2	0.1%
00:53:27	2	0.1%
23:33:58	2	0.1%
00:38:52	2	0.1%
16:53:37	2	0.1%
Other values (1906)	1942	98.9%

Frequencies of value counts

Unique

Unique	1870 ?
Unique (%)	95.2%

Histogram of lengths of the category

Length

Max length	8
Median length	8
Mean length	8
Min length	8

timezone
Categorical

CONSTANT
REJECTED

Distinct	1
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

+00:00	1964

Frequencies
Length

Value	Count	Frequency (%)
+00:00	1964	100.0%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	6
Median length	6
Mean length	6
Min length	6

dog_type
Categorical

Distinct	4
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Memory size	2.1 KiB

doggo	1714
pupper	220
puppo	27
floofer	3

Frequencies
Length

Value	Count	Frequency (%)
doggo	1714	87.3%
pupper	220	11.2%
puppo	27	1.4%
floofer	3	0.2%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	7
Median length	5
Mean length	5.115071283
Min length	5

retweet_count
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1796
Distinct (%)	91.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	8131.968941
Minimum	69
Maximum	152335
Zeros	0
Zeros (%)	0.0%
Memory size	15.3 KiB

Quantile statistics

Minimum	69
5-th percentile	380.2
Q1	1744
median	3670
Q3	10153.75
95-th percentile	28182.3
Maximum	152335
Range	152266
Interquartile range (IQR)	8409.75

Descriptive statistics

Standard deviation	11960.85694
Coefficient of variation (CV)	1.470843904
Kurtosis	32.34598187
Mean	8131.968941
Median Absolute Deviation (MAD)	2774.5
Skewness	4.460894039
Sum	15971187
Variance	143062098.8
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
355	4	0.2%
285	3	0.2%
3013	3	0.2%
2716	3	0.2%
409	3	0.2%
2096	3	0.2%
2376	3	0.2%
705	3	0.2%
2759	3	0.2%
9785	3	0.2%
Other values (1786)	1933	98.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
69	1	0.1%
93	1	0.1%
94	1	0.1%
96	1	0.1%
98	1	0.1%

Value	Count	Frequency (%)
152335	1	0.1%
129965	1	0.1%
117622	1	0.1%
113832	1	0.1%
112611	1	0.1%

fav_count
Real number (ℝ_≥0)

HIGH CORRELATION

Distinct	1543
Distinct (%)	78.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	2399.067719
Minimum	11
Maximum	75413
Zeros	0
Zeros (%)	0.0%
Memory size	15.3 KiB

Quantile statistics

Minimum	11
5-th percentile	121
Q1	534
median	1161
Q3	2740
95-th percentile	7720.2
Maximum	75413
Range	75402
Interquartile range (IQR)	2206

Descriptive statistics

Standard deviation	4287.118887
Coefficient of variation (CV)	1.786993695
Kurtosis	82.15706639
Mean	2399.067719
Median Absolute Deviation (MAD)	798.5
Skewness	7.25348446
Sum	4711769
Variance	18379388.35
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
51	5	0.3%
546	4	0.2%
589	4	0.2%
89	4	0.2%
445	4	0.2%
202	4	0.2%
81	4	0.2%
549	4	0.2%
1122	4	0.2%
941	4	0.2%
Other values (1533)	1923	97.9%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
11	1	0.1%
18	1	0.1%
29	1	0.1%
31	1	0.1%
32	1	0.1%

Value	Count	Frequency (%)
75413	1	0.1%
56146	1	0.1%
54987	1	0.1%
42467	1	0.1%
39548	1	0.1%

img_url
URL

UNIQUE

Distinct	1964
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

https://pbs.twimg.com/media/CzBD7MWVIAA5ptx.jpg	1
https://pbs.twimg.com/media/CysBn-lWIAAoRx1.jpg	1
https://pbs.twimg.com/media/CU6xVkbWsAAeHeU.jpg	1
https://pbs.twimg.com/media/CzG425nWgAAnP7P.jpg	1
https://pbs.twimg.com/media/CwxfrguUUAA1cbl.jpg	1
Other values (1959)	1959

Value	Count	Frequency (%)
https://pbs.twimg.com/media/CzBD7MWVIAA5ptx.jpg	1	0.1%
https://pbs.twimg.com/media/CysBn-lWIAAoRx1.jpg	1	0.1%
https://pbs.twimg.com/media/CU6xVkbWsAAeHeU.jpg	1	0.1%
https://pbs.twimg.com/media/CzG425nWgAAnP7P.jpg	1	0.1%
https://pbs.twimg.com/media/CwxfrguUUAA1cbl.jpg	1	0.1%
https://pbs.twimg.com/media/CUmGu7-UcAA0r3O.jpg	1	0.1%
https://pbs.twimg.com/media/CWJQ4UmWoAIJ29t.jpg	1	0.1%
https://pbs.twimg.com/media/CV6aMToXIAA7kH4.jpg	1	0.1%
https://pbs.twimg.com/media/C8GPrNDW4AAkLde.jpg	1	0.1%
https://pbs.twimg.com/media/CUES51dXIAEahyG.jpg	1	0.1%
Other values (1954)	1954	99.5%

Value	Count	Frequency (%)
https	1964	100.0%

Value	Count	Frequency (%)
pbs.twimg.com	1964	100.0%

Value	Count	Frequency (%)
/media/CWOt07EUsAAnOYW.jpg	1	0.1%
/media/CxZaqh_WQAA7lY3.jpg	1	0.1%
/media/CUJPNjOWsAAZRqP.jpg	1	0.1%
/media/CnH87L6XYAAF7I_.jpg	1	0.1%
/media/CyeTku-XcAALkBd.jpg	1	0.1%
/media/CcPNS4yW8AAd-Et.jpg	1	0.1%
/media/CUyZ6mVW4AI8YWZ.jpg	1	0.1%
/media/CfNUNetW8AAekHx.jpg	1	0.1%
/media/Ca3i7CzXIAMLhg8.jpg	1	0.1%
/media/CUibq3uVAAAup_O.jpg	1	0.1%
Other values (1954)	1954	99.5%

Value	Count	Frequency (%)
	1964	100.0%

Value	Count	Frequency (%)
	1964	100.0%

conf_tweet_img
Categorical

Distinct	4
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

1	1686
2	189
3	59
4	30

Frequencies
Length

Value	Count	Frequency (%)
1	1686	85.8%
2	189	9.6%
3	59	3.0%
4	30	1.5%

Frequencies of value counts

Unique

Unique	0 ?
Unique (%)	0.0%

Histogram of lengths of the category

Length

Max length	1
Median length	1
Mean length	1
Min length	1

p1
Categorical

HIGH CARDINALITY

Distinct	373
Distinct (%)	19.0%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

golden_retriever	137
labrador_retriever	92
pembroke	88
chihuahua	78
pug	54
Other values (368)	1515

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
golden_retriever	137	7.0%
labrador_retriever	92	4.7%
pembroke	88	4.5%
chihuahua	78	4.0%
pug	54	2.7%
chow	41	2.1%
samoyed	39	2.0%
pomeranian	38	1.9%
toy_poodle	36	1.8%
malamute	29	1.5%
Other values (363)	1332	67.8%

Frequencies of value counts

Unique

Unique	175 ?
Unique (%)	8.9%

Histogram of lengths of the category

Length

Max length	30
Median length	10
Mean length	11.35081466
Min length	2

p1_conf
Real number (ℝ_≥0)

Distinct	1961
Distinct (%)	99.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.5939284387
Minimum	0.0443334
Maximum	1
Zeros	0
Zeros (%)	0.0%
Memory size	15.3 KiB

Quantile statistics

Minimum	0.0443334
5-th percentile	0.16678155
Q1	0.36277525
median	0.587357
Q3	0.8470625
95-th percentile	0.9902437
Maximum	1
Range	0.9556666
Interquartile range (IQR)	0.48428725

Descriptive statistics

Standard deviation	0.2721339786
Coefficient of variation (CV)	0.4581932113
Kurtosis	-1.259241041
Mean	0.5939284387
Median Absolute Deviation (MAD)	0.241926
Skewness	-0.06334829058
Sum	1166.475454
Variance	0.0740569023
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.786089	2	0.1%
0.240602	2	0.1%
0.873233	2	0.1%
0.445334	1	0.1%
0.240591	1	0.1%
0.787164	1	0.1%
0.700182	1	0.1%
0.897312	1	0.1%
0.769999	1	0.1%
0.194211	1	0.1%
Other values (1951)	1951	99.3%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
0.0443334	1	0.1%
0.0553794	1	0.1%
0.0590326	1	0.1%
0.0631518	1	0.1%
0.070076	1	0.1%

Value	Count	Frequency (%)
1	1	0.1%
0.999984	1	0.1%
0.999962	1	0.1%
0.999956	1	0.1%
0.999953	1	0.1%

p1_dog
Boolean

Distinct	2
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 KiB

True	1456
False	508

Common Values
Chart

Value	Count	Frequency (%)
True	1456	74.1%
False	508	25.9%

p2
Categorical

HIGH CARDINALITY

Distinct	396
Distinct (%)	20.2%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

labrador_retriever	95
golden_retriever	81
cardigan	73
chihuahua	43
chesapeake_bay_retriever	40
Other values (391)	1632

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
labrador_retriever	95	4.8%
golden_retriever	81	4.1%
cardigan	73	3.7%
chihuahua	43	2.2%
chesapeake_bay_retriever	40	2.0%
french_bulldog	39	2.0%
pomeranian	38	1.9%
toy_poodle	36	1.8%
siberian_husky	33	1.7%
cocker_spaniel	32	1.6%
Other values (386)	1454	74.0%

Frequencies of value counts

Unique

Unique	193 ?
Unique (%)	9.8%

Histogram of lengths of the category

Length

Max length	30
Median length	10
Mean length	11.81313646
Min length	2

p2_conf
Real number (ℝ_≥0)

Distinct	1959
Distinct (%)	99.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.1346393172
Minimum	1.0113e-08
Maximum	0.488014
Zeros	0
Zeros (%)	0.0%
Memory size	15.3 KiB

Quantile statistics

Minimum	1.0113e-08
5-th percentile	0.0043655175
Q1	0.053527225
median	0.1173995
Q3	0.19556175
95-th percentile	0.32585675
Maximum	0.488014
Range	0.4880139899
Interquartile range (IQR)	0.142034525

Descriptive statistics

Standard deviation	0.1009430244
Coefficient of variation (CV)	0.7497291764
Kurtosis	0.1103241388
Mean	0.1346393172
Median Absolute Deviation (MAD)	0.0697138
Skewness	0.7674484146
Sum	264.4316191
Variance	0.01018949418
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.153126	2	0.1%
0.108382	2	0.1%
0.345298	2	0.1%
0.0693617	2	0.1%
0.150487	2	0.1%
0.159672	1	0.1%
0.0207581	1	0.1%
0.088739	1	0.1%
0.117003	1	0.1%
0.0306664	1	0.1%
Other values (1949)	1949	99.2%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1.0113e-08	1	0.1%
1.00288e-05	1	0.1%
1.44895e-05	1	0.1%
1.76343e-05	1	0.1%
2.33591e-05	1	0.1%

Value	Count	Frequency (%)
0.488014	1	0.1%
0.467678	1	0.1%
0.464816	1	0.1%
0.460565	1	0.1%
0.454937	1	0.1%

p2_dog
Boolean

Distinct	2
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 KiB

True	1473
False	491

Common Values
Chart

Value	Count	Frequency (%)
True	1473	75.0%
False	491	25.0%

p3
Categorical

HIGH CARDINALITY

Distinct	403
Distinct (%)	20.5%
Missing	0
Missing (%)	0.0%
Memory size	15.3 KiB

labrador_retriever	76
chihuahua	57
golden_retriever	45
eskimo_dog	36
kelpie	33
Other values (398)	1717

Frequencies
Length

Common Values
Overview

Value	Count	Frequency (%)
labrador_retriever	76	3.9%
chihuahua	57	2.9%
golden_retriever	45	2.3%
eskimo_dog	36	1.8%
kelpie	33	1.7%
kuvasz	31	1.6%
chow	30	1.5%
staffordshire_bullterrier	30	1.5%
toy_poodle	29	1.5%
beagle	28	1.4%
Other values (393)	1569	79.9%

Frequencies of value counts

Unique

Unique	182 ?
Unique (%)	9.3%

Histogram of lengths of the category

Length

Max length	30
Median length	10
Mean length	11.47046843
Min length	2

p3_conf
Real number (ℝ_≥0)

Distinct	1962
Distinct (%)	99.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%

Mean	0.06028936073
Minimum	1.74017e-10
Maximum	0.273419
Zeros	0
Zeros (%)	0.0%
Memory size	15.3 KiB

Quantile statistics

Minimum	1.74017e-10
5-th percentile	0.00086912295
Q1	0.016197075
median	0.0494792
Q3	0.091622775
95-th percentile	0.15712265
Maximum	0.273419
Range	0.2734189998
Interquartile range (IQR)	0.0754257

Descriptive statistics

Standard deviation	0.05096696569
Coefficient of variation (CV)	0.8453724683
Kurtosis	0.4520632132
Mean	0.06028936073
Median Absolute Deviation (MAD)	0.0368075
Skewness	0.8946179434
Sum	118.4083045
Variance	0.002597631592
Monotocity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.15713	2	0.1%
0.10142	2	0.1%
0.0637031	1	0.1%
0.0312179	1	0.1%
0.0258743	1	0.1%
0.0254563	1	0.1%
0.209393	1	0.1%
0.0658134	1	0.1%
0.113903	1	0.1%
0.0943533	1	0.1%
Other values (1952)	1952	99.4%

Minimum 5 values
Maximum 5 values

Value	Count	Frequency (%)
1.74017e-10	1	0.1%
2.1609e-07	1	0.1%
5.59504e-07	1	0.1%
8.83283e-07	1	0.1%
1.43447e-06	1	0.1%

Value	Count	Frequency (%)
0.273419	1	0.1%
0.271042	1	0.1%
0.270673	1	0.1%
0.255182	1	0.1%
0.247619	1	0.1%

p3_dog
Boolean

Distinct	2
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 KiB

True	1424
False	540

Common Values
Chart

Value	Count	Frequency (%)
True	1424	72.5%
False	540	27.5%

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

First rows

	tweet_id	source_app	text	rating_numerator	rating_denominator	name	date	time	timezone	dog_type	retweet_count	fav_count	img_url	conf_tweet_img	p1	p1_conf	p1_dog	p2	p2_conf	p2_dog	p3	p3_conf	p3_dog
0	892420643555336193	Twitter for iPhone	This is Phineas. He's a mystical boy. Only ever appears in the hole of a donut. 13/10 https://t.co/MgUWQ76dJU	13.0	10	Phineas	2017-08-01	16:23:56	+00:00	doggo	35357	7467	https://pbs.twimg.com/media/DGKD1-bXoAAIAUK.jpg	1	orange	0.097049	False	bagel	0.085851	False	banana	0.076110	False
1	892177421306343426	Twitter for iPhone	This is Tilly. She's just checking pup on you. Hopes you're doing ok. If not, she's available for pats, snugs, boops, the whole bit. 13/10 https://t.co/0Xxu71qeIV	13.0	10	Tilly	2017-08-01	00:17:27	+00:00	doggo	30606	5544	https://pbs.twimg.com/media/DGGmoV4XsAAUL6n.jpg	1	chihuahua	0.323581	True	pekinese	0.090647	True	papillon	0.068957	True
2	891815181378084864	Twitter for iPhone	This is Archie. He is a rare Norwegian Pouncing Corgo. Lives in the tall grass. You never know when one may strike. 12/10 https://t.co/wUnZnhtVJB	12.0	10	Archie	2017-07-31	00:18:03	+00:00	doggo	23029	3670	https://pbs.twimg.com/media/DGBdLU1WsAANxJ9.jpg	1	chihuahua	0.716012	True	malamute	0.078253	True	kelpie	0.031379	True
3	891689557279858688	Twitter for iPhone	This is Darla. She commenced a snooze mid meal. 13/10 happens to the best of us https://t.co/tD36da7qLQ	13.0	10	Darla	2017-07-30	15:58:51	+00:00	doggo	38629	7634	https://pbs.twimg.com/media/DF_q7IAWsAEuuN8.jpg	1	paper_towel	0.170278	False	labrador_retriever	0.168086	True	spatula	0.040836	False
4	891327558926688256	Twitter for iPhone	This is Franklin. He would like you to stop calling him "cute." He is a very fierce shark and should be respected as such. 12/10 #BarkWeek https://t.co/AtUZn91f7f	12.0	10	Franklin	2017-07-29	16:00:24	+00:00	doggo	36896	8240	https://pbs.twimg.com/media/DF6hr6BUMAAzZgT.jpg	2	basset	0.555712	True	english_springer	0.225770	True	german_short-haired_pointer	0.175219	True
5	891087950875897856	Twitter for iPhone	Here we have a majestic great white breaching off South Africa's coast. Absolutely h*ckin breathtaking. 13/10 (IG: tucker_marlo) #BarkWeek https://t.co/kQ04fDDRmh	13.0	10	None	2017-07-29	00:08:17	+00:00	doggo	18608	2755	https://pbs.twimg.com/media/DF3HwyEWsAABqE6.jpg	1	chesapeake_bay_retriever	0.425595	True	irish_terrier	0.116317	True	indian_elephant	0.076902	False
6	890971913173991426	Twitter for iPhone	Meet Jax. He enjoys ice cream so much he gets nervous around it. 13/10 help Jax enjoy more things by clicking below\n\nhttps://t.co/Zr4hWfAs1H https://t.co/tVJBRMnhxl	13.0	10	Jax	2017-07-28	16:27:12	+00:00	doggo	10807	1791	https://pbs.twimg.com/media/DF1eOmZXUAALUcq.jpg	1	appenzeller	0.341703	True	border_collie	0.199287	True	ice_lolly	0.193548	False
7	890729181411237888	Twitter for iPhone	When you watch your owner call another dog a good boy but then they turn back to you and say you're a great boy. 13/10 https://t.co/v0nONBcwxq	13.0	10	None	2017-07-28	00:22:40	+00:00	doggo	59545	16705	https://pbs.twimg.com/media/DFyBahAVwAAhUTd.jpg	2	pomeranian	0.566142	True	eskimo_dog	0.178406	True	pembroke	0.076507	True
8	890609185150312448	Twitter for iPhone	This is Zoey. She doesn't want to be one of the scary sharks. Just wants to be a snuggly pettable boatpet. 13/10 #BarkWeek https://t.co/9TwLuAGH0b	13.0	10	Zoey	2017-07-27	16:25:51	+00:00	doggo	25626	3813	https://pbs.twimg.com/media/DFwUU__XcAEpyXI.jpg	1	irish_terrier	0.487574	True	irish_setter	0.193054	True	chesapeake_bay_retriever	0.118184	True
9	890240255349198849	Twitter for iPhone	This is Cassie. She is a college pup. Studying international doggo communication and stick theory. 14/10 so elegant much sophisticate https://t.co/t1bfwz5S2A	14.0	10	Cassie	2017-07-26	15:59:51	+00:00	doggo	29230	6479	https://pbs.twimg.com/media/DFrEyVuW0AAO3t9.jpg	1	pembroke	0.511319	True	cardigan	0.451038	True	chihuahua	0.029248	True

Last rows

	tweet_id	source_app	text	rating_numerator	rating_denominator	name	date	time	timezone	dog_type	retweet_count	fav_count	img_url	conf_tweet_img	p1	p1_conf	p1_dog	p2	p2_conf	p2_dog	p3	p3_conf	p3_dog
1954	666058600524156928	Twitter for iPhone	Here is the Rand Paul of retrievers folks! He's probably good at poker. Can drink beer (lol rad). 8/10 good dog https://t.co/pYAJkAe76p	8.0	10	None	2015-11-16	01:01:59	+00:00	doggo	103	51	https://pbs.twimg.com/media/CT5Qw94XAAA_2dP.jpg	1	miniature_poodle	0.201493	True	komondor	0.192305	True	soft-coated_wheaten_terrier	0.082086	True
1955	666057090499244032	Twitter for iPhone	My oh my. This is a rare blond Canadian terrier on wheels. Only $8.98. Rather docile. 9/10 very rare https://t.co/yWBqbrzy8O	9.0	10	None	2015-11-16	00:55:59	+00:00	doggo	263	120	https://pbs.twimg.com/media/CT5PY90WoAAQGLo.jpg	1	shopping_cart	0.962465	False	shopping_basket	0.014594	False	golden_retriever	0.007959	True
1956	666055525042405380	Twitter for iPhone	Here is a Siberian heavily armored polar bear mix. Strong owner. 10/10 I would do unspeakable things to pet this dog https://t.co/rdivxLiqEt	10.0	10	None	2015-11-16	00:49:46	+00:00	doggo	403	214	https://pbs.twimg.com/media/CT5N9tpXIAAifs1.jpg	1	chow	0.692517	True	tibetan_mastiff	0.058279	True	fur_coat	0.054449	False
1957	666051853826850816	Twitter for iPhone	This is an odd dog. Hard on the outside but loving on the inside. Petting still fun. Doesn't play catch well. 2/10 https://t.co/v5A4vzSDdc	2.0	10	None	2015-11-16	00:35:11	+00:00	doggo	1098	752	https://pbs.twimg.com/media/CT5KoJ1WoAAJash.jpg	1	box_turtle	0.933012	False	mud_turtle	0.045885	False	terrapin	0.017885	False
1958	666050758794694657	Twitter for iPhone	This is a truly beautiful English Wilson Staff retriever. Has a nice phone. Privileged. 10/10 would trade lives with https://t.co/fvIbQfHjIe	10.0	10	None	2015-11-16	00:30:50	+00:00	doggo	121	51	https://pbs.twimg.com/media/CT5Jof1WUAEuVxN.jpg	1	bernese_mountain_dog	0.651137	True	english_springer	0.263788	True	greater_swiss_mountain_dog	0.016199	True
1959	666049248165822465	Twitter for iPhone	Here we have a 1949 1st generation vulpix. Enjoys sweat tea and Fox News. Cannot be phased. 5/10 https://t.co/4B7cOc1EDq	5.0	10	None	2015-11-16	00:24:50	+00:00	doggo	96	39	https://pbs.twimg.com/media/CT5IQmsXIAAKY4A.jpg	1	miniature_pinscher	0.560311	True	rottweiler	0.243682	True	doberman	0.154629	True
1960	666044226329800704	Twitter for iPhone	This is a purebred Piers Morgan. Loves to Netflix and chill. Always looks like he forgot to unplug the iron. 6/10 https://t.co/DWnyCjf2mx	6.0	10	None	2015-11-16	00:04:52	+00:00	doggo	265	124	https://pbs.twimg.com/media/CT5Dr8HUEAA-lEu.jpg	1	rhodesian_ridgeback	0.408143	True	redbone	0.360687	True	miniature_pinscher	0.222752	True
1961	666033412701032449	Twitter for iPhone	Here is a very happy pup. Big fan of well-maintained decks. Just look at that tongue. 9/10 would cuddle af https://t.co/y671yMhoiR	9.0	10	None	2015-11-15	23:21:54	+00:00	doggo	109	39	https://pbs.twimg.com/media/CT4521TWwAEvMyu.jpg	1	german_shepherd	0.596461	True	malinois	0.138584	True	bloodhound	0.116197	True
1962	666029285002620928	Twitter for iPhone	This is a western brown Mitsubishi terrier. Upset about leaf. Actually 2 dogs here. 7/10 would walk the shit out of https://t.co/r7mOb2m0UI	7.0	10	None	2015-11-15	23:05:30	+00:00	doggo	119	41	https://pbs.twimg.com/media/CT42GRgUYAA5iDo.jpg	1	redbone	0.506826	True	miniature_pinscher	0.074192	True	rhodesian_ridgeback	0.072010	True
1963	666020888022790149	Twitter for iPhone	Here we have a Japanese Irish Setter. Lost eye in Vietnam (?). Big fan of relaxing on stair. 8/10 would pet https://t.co/BLDqew2Ijj	8.0	10	None	2015-11-15	22:32:08	+00:00	doggo	2354	448	https://pbs.twimg.com/media/CT4udn0WwAA0aMy.jpg	1	welsh_springer_spaniel	0.465074	True	collie	0.156665	True	shetland_sheepdog	0.061428	True

Overview

Variables

Interactions

Correlations

Pearson's r

Spearman's ρ

Kendall's τ

Phik (φk)

Cramér's V (φc)

Missing values

Sample

First rows

Last rows